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Introduction & Purpose 


The primary purpose of the District Capacity Assessment (DCA) is to assist school districts to 
implement effective innovations that benefit students. The capacity of a district to facilitate 
building-level implementation refers to the systems, activities, and resources that are necessary 
for schools to successfully adopt and sustain Effective Innovations. Additional functions include 
using the DCA as a tool to orient new members to district needs and also to monitor progress of 
capacity development. 


The specific purposes of the DCA are to: 


1. Provide a District Implementation Team (DIT) with a structured process for the 
development of a District Capacity Action Plan; 


2. Provide a DIT with information to monitor progress towards district, regional, and state 
capacity building goals; 


3. Support a common infrastructure for the implementation of Effective Innovations (El) 
to achieve desired outcomes for students; 


4. Serve as a venue to orient new DIT members to strengths and needs of the district; and 


5. Provide district, regional and state leadership with a consistent measure of the capacity 
for implementation and sustainment of Effective Innovations in districts. 


Focus of the DCA 

The DCA is administered with a specific innovation (e.g. Early Literacy, Positive Behavioral 
Interventions and Support, Multi-Tier System of Supports) in mind. An Effective Innovation is 
any set of operationally defined practices used in a defined context (e.g. schools) to achieve 
defined outcomes. |t is important to choose one innovation and answer the DCA questions with 
that innovation in mind. 


Schedule and Timeframe of DCA Administration 

It is suggested that in January or February, the DIT formally completes a baseline DCA with the 
assistance of a trained administrator and facilitator. When used for progress monitoring 
purposes; however, it is important to ensure as much consistency as possible in the facilitator 
and respondents’ roles. During progress monitoring, less formal administration processes can 
be used, which typically results in shorter administration times (often less than 45 minutes). 
During these administrations, the team reviews previous DCA scores, updates scores based on 
recent progress, and adjusts the District Capacity Action Plan as necessary. It is acceptable for a 
district to complete the DCA at any point during the year that would help achieve targeted 
functions/purposes. 
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Given the importance of the process and the complexity of the items, the anticipated duration 
to complete the DCA is one to two hours. Exact times will depend on the number of individuals 
participating and the familiarity of the team with the DCA and the process. The first 
implementation of the DCA typically takes more time than subsequent administrations. 
Preparing key documents prior to the DCA reduces the time for implementation (see page 5 for 
list of documents). 


Process and Key Roles 

The formal administration process consists of introducing the DCA and its purpose, providing an 
overview of the administration process and scoring, introducing the concepts or big ideas, 
reading each item aloud and providing any necessary clarification, facilitating the discussion 
and voting process, and recording the score for each item. Information about key roles are 
provided in the table below: 


e Atrained individual responsible for leading the discussion and adhering to 
the DCA Administration Protocol. This individual is preferably external to 
the district team and does not vote. 


DCA 
Administrator 


e An individual who has a relationship with the respondents, experience in the 
district and who supports the Administrator by helping to contextualize 
items for respondents or provide examples of work in which the district has 
engaged. The facilitator does not vote. 


Facilitator 


e Records ideas shared for action planning and any questions and issues that 


Note Taker are raised during administration. The Note Taker does not vote. 


e Respondents are knowledgeable raters including District Implementation 
Team (DIT) members and other staff intentionally selected for their 
implementation knowledge, experience with the innovation being used, and 
leadership in the district. 


Respondents 


e Observers are invited with permission of the district team to learn about the 


Observer DCA process or the activities in the district. Observers do not vote. 


Preparation for the DCA and Administration 
Prior to launching into the administration of the DCA the following should be in place: 


1. District Implementation Team agreement to DCA administration and the commitment of 
time 


2. Materials assembled in preparation for DCA administration include: 
a. Previously completed DCA forms and/or data/reports from previous DCAs if 
applicable; 
b. Blank copies (paper or electronic) accessible to all respondents; and 
c. Data sources to inform DCA assessment (District Improvement Plan needed at a 
minimum). 
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Scoring 

The District Implementation Team completes the DCA together by using the DCA Scoring Guide 
to discuss each item and come to consensus on the final score for each item. The respondents 
score each item on a 0-2 scale utilizing a simultaneous and public voting process. This type of 
voting process facilitates participation of all respondents and neutralizes any potential power 
influences in the voting process. When asked to vote (e.g. “Ready, set, vote.”), respondents 
simultaneously hold up either two fingers to vote “fully in place,” one finger to vote “partially in 
place,” or a closed hand to vote “not in place yet.” 


If the team is unable to arrive at consensus, additional data sources for each item are 
documented in the DCA Scoring Guide and should be used to help achieve consensus. 
Consensus means that voters in the minority can live with and support the majority decision on 
an item. If consensus is not able to be reached, the Facilitator encourages further discussion at 
a later time and the majority vote is recorded so that the results can be scored and graphed. 


Research Basis, Technical Adequacy, and Outcomes from the DCA Completion 
The research basis of the DCA is derived from the implementation science research literature 
and its Active Implementation Frameworks (Fixsen, Naoom et al., 2005). The Active 
Implementation frameworks “help define what needs to be done (effective interventions), how 
to establish what needs to be done, who will do the work (effective implementation), and 
establish the hospitable environment for the work (enabling contexts) to accomplish the 
positive outcomes” (Blase, Fixsen et al., 2005). The Active Implementation Frameworks are 
universal and apply to any attempt to use Effective Innovations. The frameworks consist of 
Usable Innovations, Implementation Teams, Implementation Drivers, Improvement Cycles, and 
Implementation Stages. 


The Implementation Drivers assessed by the DCA: 


e Leadership - Active involvement in facilitating and sustaining systems change to support 
implementation of the effective innovation through strategic communication, decisions, 
guidance, and resource allocation 

e Competency - Strategies to develop, improve, and sustain educators’ ability to implement 
an Effective Innovation as intended in order to achieve desired outcomes. Competency 
Drivers include: Fidelity, Selection, Training, and Coaching 

e Organization — Strategies for analyzing, communicating, and responding to data in ways 
that result in continuous improvement of systems and supports for educators to implement 
an effective innovation. Organization Drivers include: Decision Support Data System, 
Facilitative Administration, and Systems Intervention 
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DCA Scales: 


DCA Scales DCA Item #: 


Organizational Leadership 45.2).3) 45.5; 6,7) 6p 9, 10,11, 12,17, 16,19 


21, 22, 23, 24, 25, 26, 27 
Data System for Decision Making 13, 14, 15, 16, 20 


DCA Items Mapping to Implementation Drivers: 


[Competency 
PE a 


% Tae 
e i 7 


Psychometrically, the DCA’s content validity has been established and it has been 
demonstrated to have an adequate internal structure (RMSEA = .071, CFl=.93, TLI=.92), internal 
consistency (Cronbach alphas of 0.91 for the total score and 0.79 to 0.81 for the subscale 
scores), and test-retest reliability (r = .98 for Leadership, .78 for Decision Support Data System 
and Competency Scales; Ward, et al., 2019). 


Outcomes from administration of the DCA: 


1. Review and utilize the summary report with (a) Total score, (b) Scale Scores, and (c) Item 
Scores to identify areas of strength and need; 
Identify priorities to address within a plan; and 
Develop and create a District Capacity Implementation Plan that defines immediate and 
short-term actions focusing on improving capacity to implement Effective Innovations. 


Administration Prerequisites 

To assist districts in improving their capacity to implement effective innovations, administrators 
are required to successfully complete the DCA Administration online short course 
.unc.edu/resources/district-capacity-assessment-dca). 


SISEP.org is a web-based application that allows District Implementation Teams to complete the 
DCA. Team scores are entered electronically, and reports are generated to view (a) Total 
Scores, (b) Scale Scores, and (c) Item Scores. These data are used to assess current level, 
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monitor progress across time, and plan actions that will improve capacity to implement 
evidence-based practices. 


To access SISEP.org, DIT members are provided with a user ID, user type, and permission to 
enter DCA data and access reports. A user type and level of permission are determined and set 
by either the National SISEP Center, State Education Agency (SEA), or Regional Entity SISEP.org 
Coordinator. Note that once access is granted to a district, the user has access to view all of the 
district’s DCA data. The user types that can be assigned to a user are listed below in the table. 


SISEP.org User Types _ Description 

Agency Coordinator An Agency Coordinator can add and manage users for their organization, 
administer assessments, edit a submitted assessment, and view 
assessment reports. 


Assessment An Assessment Administrator can administer assessments, edit a 
Administrator submitted assessment, and view assessment reports. 
Read Only Read Only access only allows team members to view reports. 


We ask that you let us know how you use the DCA so we can use your experience and data to 
improve and expand the assessment. Please respond to Caryn Ward (contact information 
below). Thank you. 


Caryn Ward, Ph.D. 

Director of State Implementation and Scaling up Center of Evidence Based Practices 
sisep@unc.edu, Reception: 919-843-5787 

FPG Child Development Institute 

University of North Carolina at Chapel Hill 


Version 7 of the DCA 

The DCA development team uses an iterative change process based on feedback gathered from 
users (i.e., usability testing) and research findings to make continuous improvements to the 
DCA. When an instrument is in its early stages of development and use, the iterative change 
process occurs annually while the psychometric properties for the measure are being 
established. Changes to the measure are noted by changing its Version number. Minor 
refinements to the measure that are unlikely to impact user’s scores (i.e., misspellings, 
clarifications in introductory pages, slight re-wording to the scoring guide) result in a small 
incremental Version number change (i.e. 1.3 to 1.4). Significant changes to items and the 
corresponding scoring rubric that impact meaning or the scaling structure of the instrument 
result in a large Version number change (i.e. 1.3 to 2.0). At this time, the changes made to the 
DCA are significant; resulting in Version 7. 


In general, modifications to items included basic changes such as adding greater details to 
expand concepts or additional examples to increase understanding and application during 
action planning. More specific changes from Version 6.2 to 7 and their respective rationales are 
listed below: 
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Changes in criteria to enhance scoring specificity were made in items: 8, 13, 15, 19, 22, 26 
(former item #s 25) 

To provide increased clarity on the membership of the DIT, significant changes were made 
in the scoring criteria for items #1 and #2 that assesses the presence and composition of a 
DIT. 

To provide greater specification on the necessary components of an alignment process for 
El, significant changes were made to the scoring criteria of item #6 outlining the 
components of an El alignment process. 

To provide greater clarity on the role of the District in allocating resources, item #7 was 
rewritten. 

Significant changes were made to scoring criteria for item #10 that assesses communication 
practices to include “use” of a communication plan in addition to other necessary 
components of the plan. 

Addition of an item (new item #15) to the data system for decision making scale that 
captures the use of different types of data for its intended purpose. Item #16 (former item # 
15) outlines the necessary components of a problem solving process for using data. 
Significant changes were made to the item wording and scoring criteria for the formation of 
BIT (item #18) to focus on the DIT actions in supporting the formation of BITs. 

Significant changes were made to wording and scoring criteria for development of BIT 
implementation plans (#19) to assess the components of implementation plan and its 
linkage to the district improvement plan. 

Addition of an item (new item #25) to the coaching driver that captures the development 
and use of a coaching system. New item #25 outlines necessary infrastructure supports for 
the provision of effective coaching practices outlined in a coaching service delivery plan. 

To provide increased clarity and further operationalization of the selection practices, 
significant changes were made in scoring criteria on item #21, which assesses selection 
practices of staff. 

To increase clarity and further operationalization of the necessary components of a 
coaching service delivery plan and in alignment with the new item assessing the use of a 
coaching system (new item #25), significant changes were made to the scoring criteria for 
the item assessing the use of coaching service delivery plan (current item #26, former item 
#24) 

To reduce redundancy, Item # 26 assessing the provision of staff performance feedback was 
deleted since its functions are assessed in items measuring the use of data including items # 
15 and 27 (former item #25). 

To enhance clarity, minor changes in wording of score descriptors of several items were 
made. Items impacted include: 2, 3, 4,5, 9, 11, 12, 14, 17, 22, 24. 

Additional examples of potential data sources were added to items: 2, 3, 4, 6, 7, 12, 16, 17, 
20, 23. 
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DCA Administration Fidelity Checklist 


Protocol Steps Step 


Completed? 


Y=Yes; N=No 
N/A= Unsure 
or Not 
Applicable 


Respondents Invited- Administrator and/or Facilitator invites Y N N/A 
knowledgeable raters including DIT members and others 


Materials Prepared in Advance- Administrator and/or Facilitator ensures Y N N/A 
that copies (paper or electronic) of a blank DCA are available for each 

member and ensures that a room is set up with a laptop, projector, 

internet connection, and conference phone (video if possible) for any 

participants joining remotely 


Overview- Administrator provides a review of DCA, purpose, and Y N N/A 
instructions for voting 


Administration- Blank DCA is projected on screen for entire team to view. Y N N/A 
If team is using SISEP.org, the web-based version is projected on the 
screen 


Administration- Each item is read aloud. After the Administrator reads Y N N/A 
the item and highlights differences in scoring, the Facilitator says, “ready, 

set, vote” and all respondents vote simultaneously and publicly to 

neutralize influence during the voting process (e.g. hold up 2 fingers to 

vote “fully in place,” 1 finger to vote “partially in place,” or a closed hand 

to vote “not in place” or holds up a card with the number O, 1, or 2) 


Administration- Facilitator tallies the votes and notes agreement or Y N N/A 
discrepancies for each question 


Consensus- If complete agreement is reached move on to the next Y N N/A 
question. If not, the Facilitator invites an open, brief discussion of the 

reasons for differences in scoring. The group is asked to vote again. The 

vote can occur multiple times at the discretion of the Facilitator. The goal 

is to reach consensus. Consensus means that the minority voters can live 

with and support the majority decision on an item. If the minority persists 

in not being able to live with the majority vote, the Facilitator encourages 

further discussion at a later time and the majority vote is recorded so that 

the results can be scored and graphed. 


Recording- Administrator/Facilitator documents each scoring decisionon Y N N/A 
sisep.org, which is projected for all respondents to see, or on the paper 
copy used to record all votes 
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o 


Data summary- After the last question has been asked and answered, the 
Administrator/Facilitator clicks the link on SISEP.org to display graphs of 
total scores and scale scores 


10. 


Review- While viewing the graphs, Administrator/Facilitator highlights all 
of the scales that moved in a positive direction and celebrates progress 
toward 80% or better scale scores 


Y N N/A 


11. 


District Status Review- Administrator/Facilitator initiates a discussion of 
updates on achievements, progress, and major milestones or barriers that 
have occurred since previous administration 


Y N N/A 


12. 


Action- Administrator/Facilitator asks respondents to discuss three 
domains they would like to set as agenda items for their regular meetings 


Y N N/A 


13. 


Planning- If there is not sufficient time for #11 and #12 the Facilitator 
ensures that a date and time are set for the District Status Review and 
Action related to selecting domains 


Y N N/A 


14. 


Conclusion- Administrator/Facilitator thanks the team for their openness 
and for sharing in the discussion 


Y N N/A 


Comments/Notes: 
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Scoring Form 


District Name: Date: 
DCA Administrator: Facilitator: 
Effective Innovation: DIT Members: 
Directions: The District Implementation Team completes the District Capacity Assessment (DCA) 
together by using the DCA Scoring Guide to discuss each item and come to consensus on the final 
score for each item. If the team is unable to arrive at consensus, additional data sources for each 
item are documented in the DCA Scoring Guide and should be used to help achieve consensus. 
Scores are recorded on this Scoring Form below and then entered into SISEP.org. 
Item Score 
1. There is a District Implementation Team (DIT) to support implementation of 2/11] 0 
Effective Innovations (El) 
2. DIT includes an individual with executive leadership authority 2/11] 0 
3. DIT includes a designated coordinator(s) 2/1] 0 
4. DIT uses an effective team meeting process 2/11] 0 
5. District has written process for selecting Els 2/11] 0 
6. District has a written process to align Els 2/11} 0 
7. District allocates resources to support the use of the selected El (e.g., Multi- 2/11] 0 
Tiered System of Support -MTSS) 
8. DIT has an implementation plan for the El (e.g., MTSS) 2/1] 0 
9. DIT continuously improves the use of the implementation plans 2/11] 0 
10. District uses a communication plan 2;1/] 0 
11. District uses a process for addressing internal barriers 2/11] 0 
12. District uses a process to report policy relevant information to outside entities 2/11] 0 
13. DIT supports schools in the use of a fidelity measure for El (e.g., MTSS) 2/11] 0 
Implementation 
14. DIT has access to data for the El (e.g., MTSS) 2/11} 0 
15. DIT actively uses different types of data 2/11] 0 
16. DIT has a process for using data for decision making 2/11} 0 
17. District provides a status report on the El (e.g., MTSS) to the school board 2/11} 0 
18. DIT supports the composition of BITs 2/11] 0 
19. DITs support the development of BIT implementation plans for the El (e.g., 2/11} 0 
MTSS) 
20. DIT supports BITs in using data for decision making 0 
21. District uses a process for selecting staff (internal and/or external) who will use 0 
Els (e.g., MTSS) 
22. District has a plan to continuously strengthen staff skills 2/11] 0 
23. DIT secures training on the El (e.g., MTSS) for all district/school personnel 2/11] 0 
24. DIT uses training effectiveness data 2/11} 0 
25. District has a coaching system to support schools in their use of Els (e.g., MTSS) | 2 | 1 | O 
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26. DIT uses a coaching service delivery plan to support building implementation 2/1 
teams 
27. DIT uses coaching effectiveness data 2/1 
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Scoring Guide 


DCA Item: 2 points 1 point 0 points Data Source 

1. There isa A team is developed and is A team is developed and is There is no District List of team 

District representative of cross- representative of cross- Implementation team (DIT) members, roles, 

Implementation | departmental perspectives departmental perspectives and job titles 

Team (DIT) to (e.g., general education and (e.g., general education and 

support special education) special education) 

implementation -AND- 

of Effective Team members are selected 


Innovations (El) | for: 

e Experience in using of 
effective innovations 

e Positive working 
relationships with building 
leadership and staff 

e And have sufficient time to 
dedicate to DIT functions 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


2. DIT includes an 
individual with 
executive 
leadership 
authority 


DIT membership includes at 
least one executive leader 
who can make significant 
decisions within the district to 
support schools in their use of 
effective innovations without 
consulting with a higher 
authority 

-AND- 
The executive leader 
consistently attends meetings 

-AND- 
When scheduling conflicts 
occasionally occur, the leader 
makes sure (s)he is provided 
with relevant information 
(e.g., decisions and potential 
barriers that need to be 
addressed) within 1-2 days 
after the meeting 


DIT membership includes at 
least one executive leader 
who can make significant 
decisions within the district to 
support schools in their use of 
effective innovations without 
consulting with a higher 
authority 

-AND- 

The executive leader 
consistently attends meetings 
-AND- 

When scheduling conflicts 
occasionally occur, there is not 
a mechanism for the leader to 
be provided with relevant 
information within 1-2 days 
after the meeting 


There is not an executive 
leader on the DIT 

-OR- 
The executive leader’s lack 
of attendance at DIT 
meetings impedes the 
team’s ability to complete 
the activities needed to 
support schools 


Executive leader 
job description 


List of team 
members, roles, 
and job titles 


Communication 
plan linking 
district executive 
leadership to 
other 
departments and 
structures 


15 
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DCA Item: 2 points 1 point 0 points Data Source 
3. DlTincludes a DIT includes a designated DIT includes a designated DIT does not include a Coordinator job 
designated coordinator(s) who performs a | coordinator who assumes a designated coordinator description 


coordinator(s) 


lead role on the DIT by: 

e Preparing for and 
facilitating DIT meetings 

e Developing meeting 
agendas 

e Monitoring completion of 
assigned actions and 
implementation plan 

-AND- 

The coordinator(s) has direct 
and regular contact with 
executive leader(s) (e.g., 
before and after RIT and DIT 
meetings) 

-AND- 
Coordinator(s) uses 
knowledge about Els and 
implementation research in 
order to make 
recommendations to the DIT 
and the executive leader 
overseeing the DIT 

-AND- 
Individual(s) providing 
coordination have adequate 
time to fulfill responsibilities 


lead role on the DIT by: 

e Preparing for and 
facilitating the DIT 
meetings 

e Developing meeting 
agendas 

e Monitoring completion of 
assigned actions and 
implementation plan 

-AND- 
The coordinator(s) has direct 
and regular contact with 
executive leader(s) (e.g., 
before and after DIT meetings) 


-OR- 
The coordinator(s) does not 
perform a lead role on the 
DIT 

-OR- 
The coordinator(s) does not 
have regular and direct 
contact to executive 
leader(s) (e.g., before and 
after DIT meetings) 


Identification of 
executive 
leader(s) who 
work with the 
coordinator 


Time allocated 
for the 
coordinator role 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


4. DIT uses an 


effective team 
meeting process 


DIT uses the following 
effective meeting processes: 


Meets in person at least 
monthly or more 
frequently depending on 
amount of work 

Meeting roles and 
responsibilities are 
consistently assigned and 
used (e.g., facilitator, 
recorder, time keeper, 
norms monitor) 

Process is in place for 
absent staff to receive 
updates within 48 hours 
following the meeting 
Assignments and tasks are 
completed within 
designated timelines with 
progress documented on 
an action plan 


DIT uses the following 

effective meeting processes: 

e Meets in person at least 
monthly or more 
frequently depending on 
amount of work 

e Meeting roles and 
responsibilities are 
consistently assigned and 
used (e.g., facilitator, 
recorder, time keeper, 
norms monitor) 


DIT meeting processes do 
not meet the criteria in the 2 
or 1 point responses. 


Meeting schedule 


Meeting 
Agendas, 
Minutes, and 
Attendance 


Action Plan 


Documentation 
of the process for 
updating absent 
team members 
(i.e., Terms of 
Reference) 


17 


© 2019 NIRN-UNC 


District Capacity Assessment 


e Fit and alignment with 
other Els 

e Resources needed to fully 
implement 

e Capacity within the district 
to successfully use the El 

e Evidence to demonstrate 
effectiveness 

e EI’s readiness for usability 

-AND- 
Process is consistently used 


e Fit and alignment with 
other Els 

e Resources needed to fully 
implement 

e Capacity within the district 
to successfully use the El 

-OR- 
The process is not consistently 
used 


DCA Item: 2 points 1 point 0 points Data Source 
5. District has Written process is in place Written process is in place Written process is not in Guidance 
written process -AND- -AND- place documents 
for selecting Els | The process to select Els The process to select Els outlining the 
includes an analysis of the includes an analysis of the process 
following variables: following variables: 
e Need for the El e Need for the El Written 


documentation 
showing how the 
process has been 
used within the 
past 2 years 
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DCA Item: 2 points 1 point 0 points Data Source 
6. District has a Written process is in place Written process is in place Written process is not in Guidance 
written process -AND- -AND- place documents 
to align Els The process to align Els The process to align Els outlining the 

outlines: outlines: process 

e Conditions that warrant its | e Conditions that warrant its 
use use Written 

e Criteria for selecting e Criteria for selecting documentation 
people with advanced people with advanced showing how the 
knowledge of Els to knowledge of Els to alignment 
participate in the process participate in the process process has been 
Core components for Els e Core components for Els used 

e Documentation of whether | e Documentation of whether 
or not El components or not El components 
overlap or inhibit full use overlap or inhibit full use 
of other components of other components 

e Expectations for -OR- 
summarizing alignment The process is not consistently 
results used or followed 

e Adecision-making protocol 
exists to be used if the 
alignment results in 
recommendations to 
discontinue use of an El 
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implementation 
plan for the El 


to ensure the district has the 
capacity to support successful 
use and sustainability of the El 
across schools 
-AND- 
The plan has been approved 
by district executive 
leadership 
-AND- 
The plan is developed using 
the following data: 
e Capacity data (e.g., DCA) 
e Scale-up data (e.g., each 
school’s stage of 
implementation) 
e El fidelity data 
e Student outcome data 
-AND- 


The plan’s goals are S.M.A.R.T. 


-AND- 
The plan includes specific 
activities to achieve the goals 


to ensure the district has the 
capacity to support the 
successful use and 
sustainability of the El across 
schools 

-AND- 
The plan has been approved 
by district executive 
leadership 

-AND- 
The plan is developed using: 
e El fidelity data 
e Student outcome data 


implementation plan 
-OR- 

The plan has not been 

approved by district 

executive leadership 


DCA Item: 2 points 1 point 0 points Data Source 
7. District allocates | There is evidence of There is evidence of effort to There is no evidence of General fund 
resources to commitment to support the secure the commitment to commitment or effort to budget 
support use of district’s successful use and support the district’s secure commitment to allocations 
the selected El scale-up of the selected El successful use of the selected | support the selected El Grant budget 
El for a minimum of one year allocations 
or less 
DIT has an The plan’s primary purpose is | The plan’s primary purpose is | There is not an District 


implementation 
plan 


Record of 
approval 
(meeting minutes 
or other written 
communication, 
signature) 
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DCA Item: 2 points 1 point 0 points Data Source 
9. DIT Use of the implementation Use of the implementation Use of the implementation Documentation 
continuously plan is reviewed a minimum of | plan is reviewed at least two plans are reviewed once a of plan use and 
improves use of | three times per year times per year year or are not reviewed improvement 
the -AND- -AND- 
implementation | The review includes The review includes 
plans documentation of: documentation of: 
e Status of activities (e.g., e Status of activities (e.g., 
completed, partial, not- completed, partial, not- 
started) started) 
e Reasons activities are not e Reasons activities are not 
completed (e.g., completed (e.g., 
insufficient funding, insufficient funding, 
training) training) 
e Team decisions (e.g., e Team decisions (e.g., 
provide required resources provide required resources 
to complete activities, to complete activities, 
communicating barriers, communicating barriers, 
next steps) next steps) 
-AND- 
Plans are modified when data 
suggest the need 
21 © 2019 NIRN-UNC 


District Capacity Assessment 


DCA Item: 


2 points 


1 point 


0 points 


Data Source 


10. District uses a 


communication 
plan 


The plan is written and 
accessible to all staff 


-AND- 


The plan includes: 


List of internal and 
external stakeholder 
groups (e.g., internal staff 
represented in the 
organizational chart, 
necessary outside 
agencies, families) 
Person(s) responsible for 
communication with each 
group 

Frequency of 
communication (e.g., 
following each monthly 
team meeting) 

Type of information to 
disseminate and gather 
from identified 
stakeholders 

Methods of 
communication (e.g., 
regularly scheduled 
meeting, email) 
Communication 
effectiveness survey and 
timelines for gathering 
communication survey 
data 


The plan is in the process of 
being written and accessible 
to all staff 


-AND- 


The plan focuses primarily on: 


List of internal and 
external stakeholder 
groups (e.g., internal staff 
represented in the 
organizational chart, 
outside agencies, families) 
Persons responsible for 
communication with each 
group 
Frequency and methods of 
communication 

-OR- 
The plan is inconsistently 
used. 


There is not a plan for 
communication or the plan 
is not in use 

-OR- 
Stakeholders are reporting 
communication to be 
ineffective 


Communication 
plan 


Stakeholder 
report summaries 
indicating 
communication 
has been 
effective 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


-AND- 
Plan is consistently used 
- AND - 
Stakeholders report that 
communication has been 
effective 


11. District uses a 
process for 
addressing 


internal barriers 


A written process is in place 
outlining steps needed to 
identify and address barriers 

-AND- 
The process is consistently 
used to remove internal 
barriers (e.g., policy and 
guidance documents are 
revised to support new ways 
of work, resources are 
allocated/re-allocated, 
competing or ineffective 
initiatives are modified or 
removed) 

-AND- 
Follow-up determines if 
barrier was addressed 
effectively 


The process is informal 

-OR- 
The process is inconsistently 
used 


There is not a process 

-OR- 
The process is not used for 
addressing internal barriers 
that prevent successful use 
of the El 


Guidance 
document 
outlining process 


Documentation 
showing how the 
process has been 
used in the past 
six months (e.g., 
examples of 
identifying a 
barrier, defining a 
solution, and 
implementing the 
solution with 
effect) 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


12. District uses a 


process to 
report policy 
relevant 
information to 
outside entities 


A written process is in place to 
gather policy relevant 
information to help identify: 
e Strengths of the state 
system 
e Barriers that need to be 
resolved at the regional 
and/or state level to 
support district 
implementation efforts 
(e.g., state/federal laws, 
mandated use of funds, 
interpretation of legislative 
language) 
-AND- 
The process is consistently 
used by staff and executive 
leadership for reporting 
information to the identified 
contact liaison with the 
Regional Agency and/or State 
Education Agency (SEA) 


A written process is in place 
and used inconsistently 


There is not a written 
process 

-OR- 
Staff and executive 
leadership are unaware of 
how to use the process 


Guidance 
document 
outlining process 


Gathering of 
information from 
districts and 
regions 


Documentation 
of reporting the 
gathered 
information (e.g., 
reports, meeting 
minutes, 
agendas) 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


13. DIT supports 
schools in use of 
a fidelity 
measure for El 
Implementation 


The El fidelity measure is 

appropriate for assessing El 

use: 

e Measure is a research- 
validated fidelity measure 
(i.e., highly correlated with 


The El fidelity measure is 

appropriate for assessing El 

use: 

e Measure is a research- 
validated fidelity measure 
(i.e., highly correlated with 


DIT does not support schools 
to use a fidelity measure for 
the El 

-OR- 
DIT does not support schools 
use of the fidelity measure 


Fidelity measure 
or practice profile 


Data (e.g., local 
or published) 
demonstrating 


or predictive of intended or predictive of intended as recommended (e.g., that fidelity 
outcomes for Els) outcomes for Els) frequency, audience) predicts intended 
-AND- -OR- outcomes 

DIT supports schools use of e The fidelity measure is in 

fidelity measures as process of being validated 

recommended (e.g., proactive 

orientation of staff to the 

fidelity measure, 

administration, scoring, data 

entry, report generation, and 

analysis) 

14. DIT has access All of the following data are The DIT only has access to at The DIT has access to less Sample data 
to data for the accessible for the DIT to least three but not all of the than three of the data reports 


El 


analyze: 

e El Fidelity data 

e Student outcome data 
(e.g., universal screening 
data, progress monitoring 
data, and summative 
assessment data) 

e Capacity data (e.g., DCA) 

e Scale-up data (e.g., Stages 
of Implementation 
Analysis: Where are We 
Now) 


following types of data: 

e El fidelity data 

e Student outcome data 
e Capacity data 

e Scale-up data 


sources listed in the 2-point 
response 
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Fidelity data are analyzed 
to improve 
implementation supports 
(e.g., selection, training, 
coaching supports to 
ensure El is being 
implemented as intended) 
Student outcome data 
(screening, progress 
monitoring, summative 
assessments/state test) 
are used to determine the 
impact the El is having on 
student outcomes 
Capacity data for the El are 
used to enhance 
leadership, organizational 
or competency supports 
Scale-up data are used to 
create differentiated plans 
for schools based on their 
current stage of 
implementation 


e Fidelity data 

e Student outcome data 
e Capacity data 

e Scale up data 


on outcomes. 


DCA Item: 2 points 1 point 0 points Data Source 
15. DIT actively uses | All of the following different DIT uses at least two of the DIT primarily uses student Sample data 
different types | types of data are used for their | following types of data for outcome datato determine | reports 
of data. intended purposes: their intended purposes: the impact the El is having 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


16. DIT has a 
process for 
using data for 
decision making 


DIT uses a problem-solving 
process (e.g. Improvement 
Cycles) at least three times a 
year 

-AND- 

The process for using data 

includes: 

e Analysis of all new data 
that results in a summary 
of celebrations and precise 
problem statements 

e Generation of hypotheses 
identifying factors 
contributing or 
maintaining the problem 

e Analysis of data to validate 
or generate new 
hypotheses 

e Refinement of the 
implementation plan 
including S.M.A.R.T. goals 
and activities that lead to 
desired outcomes 


DIT uses a problem-solving 

process (e.g. Improvement 

Cycles) at least once a year 

-AND- 

The process for using data 

includes: 

e Analysis of all new data 
that results in a summary 
of celebrations and precise 
problem statements 


DIT uses a problem-solving 
process (e.g. Improvement 
Cycles) that does not meet 
the conditions of the 2 or 1- 
point response 

-OR- 
DIT does not have a 
problem-solving process 


Graphic of 
problem-solving 
process 


Evidence that 
improvement 
cycles resulted in 
refinement of the 
implementation 
plan 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


17. District provides 


a status report 
on the El to the 
school board 


The report includes at least 
five of the following types of 
information: 

e Number of schools across 
the district working to 
successfully use the El 

e Each school’s stage of 
implementation 

e Development of internal 
capacity to build structures 
to support the El 
(leadership, organization, 
competency) 

e El fidelity data 

e Impact on student 
outcomes 

e Stakeholder information 
(e.g., survey data from 
staff and parents) about 
implementation supports 

e Upcoming work to scale- 
up the El and continue 
improving its use 

-AND- 

Report is disseminated a 

minimum of twice per year 


The report includes at least 4 
of the 7 different types of 
information outlined in the 2- 
point criteria 

-OR- 
The report is only 
disseminated once per year 


A status report is not 

provided to stakeholders 
-OR- 

Report focuses primarily on 

action, instead of data 


Copy of most 
recent school 
board status 
report or 
presentation 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


18. DIT supports the 
composition of 
BITs 


DIT members provide 
guidance to principals and 
school staff in understanding 
best practices for BIT 
composition by focusing on 
the following: 

e School-wide assessment / 
audit of teaming structures 
to determine if BIT 
functions are being 
addressed by an existing 
team 

e Cross-departmental team 
composition (e.g., general 
education and special 
education) 

e Team size 
Selection of the personnel 
to perform key roles on 
the team (e.g., 
coordination) 

e Experience of team 
members (e.g., successful 
use of Els, positive 
relationships with staff, 
adequate time to fulfill 
responsibilities) 

AND- 

DIT provides guidance to BIT 

to coordinate their work with 

other school initiatives (e.g., 


DIT members provide 
guidance to principals and 
school staff in understanding 
best practices for BIT 
composition by focusing on 
the following: 

e Cross-departmental team 
composition (e.g., general 
education and special 
education) 

e Team size 


DIT members do not provide 
guidance to principals and 
school staff in understanding 
best practices for BIT 
composition in a way that 
meets the conditions of the 
1- or 2-point responses 


List of BIT 
members 


Document 
outlining school 
teams 


Linking 
communication 
protocol for DIT 
and BITs and BITs 
and other school 
teams 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


discuss alignment of district 
and school priorities, barriers) 


19. DITs support the 


development of 
BIT 
implementation 
plans for the El 


The primary purpose of the 
plans is to ensure BITs support 
staff to successfully use El 
components 

-AND- 
The plan is developed using 
the following data: 
e Student outcome data 
e El fidelity data 

-AND- 


The plan’s goals are S.M.A.R.T. 


-AND- 
The plan includes specific 
activities to achieve the goals 
AND 
The plan is linked to district 
priorities within the district 
improvement plan 


The primary purpose of the 
plans is to ensure BITs support 
staff to successfully use El 
components 
-AND- 
The plan is developed using 
the following data: 
e Student outcome data 
-AND- 
The plan includes specific 
activities to achieve the goals 


BITs do not have 

implementation plans 
-OR- 

The plans do not meet the 

criteria outlined in the 2 or 

1-point response 


School level plan 
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decision making 


three times per year 
-AND- 

The process for using data 

includes: 

e Analysis of all new data 
that results in a summary 
of celebrations and precise 
problem statements 

e Generation of hypotheses 
identifying factors 
contributing to the 
problem 

e Analysis of data to validate 
or generate new 
hypotheses 

e Refinement of the 
implementation plan 
(S.M.A.R.T. goals and 
activities) to address the 
problem 


once per year 
-AND- 

The process for using data 

includes: 

e Analysis of all new data 
that results in a summary 
of celebrations and precise 
problem statements 


BIT uses a problem-solving 
process (e.g. Improvement 
Cycles) that does not meet 
the conditions of the 2 or 1- 
point response 


DCA Item: 2 points 1 point 0 points Data Source 
20. DIT supports DIT supports BITs use of a DIT supports BITs use of a BITs do not use a problem- Evidence of the 
BITs in using problem-solving process (e.g. problem-solving process (e.g. | solving process problem-solving 
data for Improvement Cycle) at least Improvement Cycle) at least -OR- process 


Evidence that 
improvement 
cycles resulted in 
refinement of the 
implementation 
plan 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


21. District uses a 
process for 
selecting staff 
(internal and/or 
external) who 
will use Els 


Job descriptions exist that 
describe pre-requisite 
knowledge and responsibilities 
required 


-AND- 
The selection process includes 
the following: 


e Performance assessment 
asking individual(s) to 
demonstrate required 
knowledge, skills, and 
abilities (e.g., simulated 
activity, role-plays, product 
development) 

e Feedback provided to 
individuals to assess their 
use of feedback (e.g., 
incorporating feedback 
into subsequent portions 
of the selection process) 


-AND- 
Interview protocol is revised 
as needed to improve the 
selection process 


Broad job descriptions exist 


-AND- 
The selection process is 
aligned with pre-requisite 
knowledge and responsibilities 
but does not meet the criteria 
outlined in the 2-point 
response 


Broad job descriptions exist 


-AND- 
Generic job interview 
protocol used during the 
selection process does not 
assess pre-requisite 
knowledge and 
responsibilities required 
(e.g., similar protocol used 
for any position) 


Job descriptions 


Interview 
protocol 
(including 
procedures used 
during the 
selection process) 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


22. District has a 


plan to 
continuously 
strengthen staff 
skills 


All staff (newly selected and 

existing) assigned to use or 

support the use of Els have a 

written professional learning 

plan that includes: 

e Areas for further 
development 

e Type of professional 
learning that will be 
provided to develop 
knowledge, skills and 
abilities (e.g., attending a 
professional learning 
session, independent 
reading with structured 
dialogue to reflect on 
readings) 

e Timeline for completing 
learning 

e Person(s) assigned to 
support staff 


-AND- 

e Time is allocated for staff 
to develop knowledge, 
skills, and abilities that are 
outlined in the plan 


All staff have a written 
professional learning plan that 
includes at least 2 of the 
criteria outlined in the 2-point 
response 


-OR- 
Some staff have a professional 
learning plan that includes all 
the criteria outlined in the 2- 
point response 


None of the staff have a 
written professional learning 
plan 

- OR - 
Written professional 
learning plans do not meet 
the criteria outlined in the 2- 
point response 


Staff professional 
learning plans 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


23. DIT secures 


training in the El 
for all 
district/school 
personnel 


Training is prioritized for 
district staff in El specific data, 
systems, and practices 

-AND- 
Highly competent individuals 
provide trainings (e.g., trainers 
have deep knowledge in areas 
they are providing training and 
use effective presentation and 
engagement skills) 

-AND- 
Trainings are skill based, 
include opportunities for 
practice/behavioral rehearsals 
when applicable, and provide 
participant feedback 


Training is prioritized for 
district staff in El specific data, 
systems, and practices 

-AND- 
Highly competent individuals 
provide trainings (e.g., trainers 
have deep knowledge in areas 
they are providing training and 
use effective presentation and 
engagement skills) 


The district does not secure 
training in the El 

-OR- 
Trainings do not meet the 
criteria outlined in the 2 or 
1-point response 


Professional 
learning: 
schedule, 
outlines, 
agendas, 
participant 
materials 


Professional 
learning 
participant 
evaluations 


Presenter 
qualifications 
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effectiveness 
data 


e Pre and post assessment of 
knowledge and skills 

e Observation of participants 
practicing and applying 
newly acquired skills 

e Trainer performance 
feedback (e.g., feedback on 
training content, training 
process, delivery) 

-AND- 

Training effectiveness data 

are analyzed to: 

e Inform improvements to 
the content and delivery 

e Inform improvements in 
recruitment and selection, 
training, coaching, and 
other implementation 
supports 


data: 

e Pre and post assessment of 
knowledge and skills 

e Observation of participants 
practicing and applying 
newly acquired skills 

e Trainer performance 
feedback 


-AND- 
Training effectiveness data 
are analyzed to: 
e Inform improvements to 
the training content and 
delivery 


effectiveness of training 


DCA Item: 2 points 1 point 0 points Data Source 
24. DIT uses DIT uses the following types of | DIT uses two of the following Data are not analyzed or Training outcome 
training training effectiveness data: types of training effectiveness | used to determine data 


Evidence that 
data are used for 
improvements 


25. District has a 


coaching 
system to 
support schools 
in their use of 
Els 


The coaching system is 
developed to ensure BITs and 
school staff have equitable 
access to high-quality coaching 
to successfully use Els 

-AND- 


The coaching system is 
developed to ensure BITs and 
school staff have equitable 
access to high-quality coaching 
to successfully use Els 

-OR- 


There is not a coaching 
system 

-OR- 
The coaching system does 
not meet the criteria of the 
2- or 1-point response 


Coaching system 
document 
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DCA Item: 


2 points 


1 point 


0 points 


Data Source 


The coaching system includes 

the following: 

e Definition of coaching 

e Conditions that warrant 
coaching 

e Pre-requisite knowledge 
needed for coaches 

e Responsibilities of coaches 

e Selection guidelines for 
coaches (for existing or 
new staff that will be 
assigned districts to coach) 

e Allocation of time for staff 
to provide coaching to BITs 
and school staff 

e Statement clarifying 
coaches’ decision-making 
authority 

e Coaching service delivery 
plan 

e Communication protocol 
between coaches and 
other groups / teams 
internal and external to 
the district 

e Supervision and 
accountability structures 

-AND- 
The coaching system is 
consistently used 


The coaching system includes 
at least 6 of the criteria 
outlined in the 2-point 
response 

-OR- 
The coaching system is 
inconsistently used 


-OR- 
The coaching system is not 
used 
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service delivery 
plan 


Stage-based coaching 
concepts that distinguish 
supports to BITs and / or 
school staff 
Continuum of coaching 
strategies needed to 
develop the team’s 
knowledge, skills, and 
abilities (e.g., observation, 
prompting, modeling, 
assistance in adapting to 
local context, fluency 
building) 
Coaching effectiveness 
measures (El fidelity data, 
observation, products, 
coaching satisfaction 
survey data) 
Frequency of coaching 
Expectations for the 
coach’s preparation 
Guidelines for providing 
feedback (e.g., conceptual 
feedback components, 
specific behaviors, 
timelines for providing 
written feedback) 

-AND- 


Stage-based coaching 
concepts that distinguish 
supports to BITs and / or 
school staff 

Continuum of coaching 
strategies needed to 
develop the team’s 
knowledge, skills, and 
abilities (e.g., observation, 
prompting, modeling, 
assistance in adapting to 
local context) 

Coaching effectiveness 
measures (EI fidelity data, 
products, coaching 
satisfaction survey data) 


-OR- 
Coaching supports provided 
to BITs do not meet the 
criteria in the 1-point 
response 

-OR- 
The coaching service 
delivery plan is not being 
used 


DCA Item: 2 points 1 point 0 points Data Source 
26. DIT uses a Coaching supports provided Coaching supports provided Coaching service delivery Sample of 
coaching are documented and includes: | are documented and includes: | plan does not exist coaching service 


delivery plans 


37 


© 2019 NIRN-UNC 


District Capacity Assessment 


At least three sources of data 

are used: 

e El fidelity data 

e BIT observations 

e Product reviews 

e Coaching satisfaction 
survey results (coaching 
recipients) 

e Coaching service delivery 
adherence data 

e Coaches’ self-reflections 
using data 

e Coaching logs 

-AND- 

Coaching effectiveness data 

are utilized to inform 

improvements in coaching, 

recruitment and selection, 

training, and other 

implementation supports 


are used from the 2-point 
response 

-AND- 
Coaching effectiveness data 
are only used to inform 
coaching improvements 


DCA Item: 2 points 1 point 0 points Data Source 
Adherence to the coaching 
service delivery plans is 
reviewed three times a year 
27. DIT uses Coaching effectiveness is Coaching effectiveness is Coaching effectiveness is not | Coaching 
coaching assessed at least three times a | assessed at least annually assessed and multiple effectiveness 
effectiveness year -AND- sources of data are not used. | data such as 
data -AND- At least two sources of data staff satisfaction 


surveys 


Evidence the data 
are used to 
inform 
improvements 
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Action Planning 


Step 1: For any item listed below a “2” consider actions that may be completed within the next 
3 months. 


Step 2: Define the action, "who" is responsible, when it will be accomplished, and the 
team/meeting when updates on the action will be reviewed. 


Step 3: Team should prioritize the areas or items that are most critical to improve- critical 
defined as most likely to improve fidelity, sustainability and student outcomes. 


Scales and Drivers Action Who When Next 
Update 


Organizational Leadership 


Leadership 


Facilitative Administration 


Systems Intervention 


Competency 


Selection 


Training 


Coaching 


Data System for Decision 
Making 


Fidelity 


Decision Support Data 
System 
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Glossary 


Browse the glossary below to learn the vocabulary terms commonly encountered in the DCA. 
To successfully administer the DCA, knowledge of these terms is necessary. The glossary was 
compiled using the following resources: SISEP’s Active Implementation Hub, National 
Implementation Research Network, and PBIS.org. 


Authority 


Authority in the context of the DCA refers to the power or right to make decisions regarding 
budgets, positions, and allocation of resources. 


Building Implementation Team (BIT) 


An organized and active group that supports the implementation, sustainability, and scale-up of 
Effective Innovations by integrating the use of implementation stages, drivers and 
improvement cycles. 


Capacity 


Systems, activities, and resources that are necessary for schools to successfully adopt and 
sustain effective innovations. 


Coaching 


Coaching is defined as regular, embedded professional development designed to help teachers 
and staff to use the program or innovation as intended. 


Coaching Service Delivery Plan 


A written plan detailing the frequency of coaching observations, methods of support, and 
routines and methods (e.g. written, verbal) for providing constructive feedback in a safe 
environment. 


Communication Protocol 


A written document outlining the frequency, type, and format of communication between 
teams for the following purposes: communicate progress and celebrate success throughout the 
system, report systemic barriers that are preventing or hindering implementation and should 
be resolved by one of the groups, report on actions taken to resolve or address past issues, and 
revisit past decisions and agreements periodically to ensure that solutions are still functional. 


40 © 2019 NIRN-UNC 


District Capacity Assessment 


Coordinator 


District staff member assuming a lead role in preparing for and facilitating the DIT meetings, 
agenda topics and monitoring completion of assigned actions. 


Decision Support Data System 


A system for identifying, collecting, and analyzing data that are useful to the teacher, school, 
and district for decision making to improve implementation of the El. Specifically, the utilization 
of process data, performance (fidelity) data, and outcome data is measured and data are used. 


Diagnostic Assessment 


Assessments which provide more in-depth information about an individual student’s specific 
skill, for the purpose of guiding future instructional supports. 


District Capacity Action Plan 


A detailed plan outlining actions needed to reach one or more goals for improving district 
capacity. 


District Implementation Plan 


A detailed plan outlining actions needed to reach one or more goals for effective and sustained 
implementation of an El. 


District Implementation Team 


An organized and active group that supports the implementation, sustainability, and scale-up of 
Effective Innovations by integrating the use of implementation stages, drivers and 
improvement cycles. 


District Improvement Plan 


A detailed plan outlining actions needed to reach one or more goals for performance 
improvement. 


Effective Innovation 


An innovation is anything that is new to a district and that is intended for use to improve 
effectiveness or efficiency. The innovation was developed based on the best available evidence 
(e.g., evaluation results, research findings). 


Executive Leadership 
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A process of social influence in which a person can enlist the aid and support of others in the 
accomplishment of a specific task. 

Fidelity 


Fidelity is defined as doing what is intended. 


Formal 
Formal refers to an established hierarchy, procedure or set of specific behaviors. 
Facilitative Administration 


Organization driver focused on the internal processes, policies, regulations, and structures over 
which a district implementation team has some control in order to create and maintain 
hospitable environments to support new ways of work. 


Guidance Documents 
Publicly available documents outlining a process and/or procedure and its implementation. 
Implementation 


A specified set of activities designed to put into practice an activity or program of known 
dimensions. According to this definition, implementation processes are purposeful and 
described in sufficient details such that independent observers can detect the presence and 
strength of the “specific set of activities” related to implementation. 


Implementation Science 


Implementation science is the study of methods to promote the integration of research findings 
and evidence into policy and practice. It seeks to understand the behavior of professionals and 
other stakeholders as key variables in the sustainable uptake, adoption, implementation, and 
sustainability of Effective Innovations. 


Improvement Cycles 


Improvement cycle is a planned sequence of systematic and documented activities aimed at 
improving a process (e.g., PDSA Cycle — Plan, Do, Study, Act). 


Informal 


Informal refers to an activity or process that is marked by the absence of formality or structure. 
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Interview Protocol 
A document outlining the various activities used within a selection process of a staff member. 
Performance Assessment 


Performance assessment refers to measuring the degree to which a teacher or staff are able to 
use the intervention or instructional practices as intended. Performance assessment (fidelity) 
measures the extent to which an innovation is implemented as intended. 


Policy Relevant Information 


Data and material that can be used to inform the development and/or refinement of a policy or 
statement of intent adopted by a Board or senior governance body. 


Progress Monitoring 


Frequent assessment to provide more in-depth information about an individual student’s 
specific skills, for the purpose of guiding instructional supports. 


Readiness for Usability 


Reflects the potential (e.g., feasibility, operationally defined, scalable) of the El to be used 
across settings. 


Regional Unit 


An educational entity providing various school districts within a specified geographic region of 
the state with a wide array of educational programs and services, many of which are too costly 
or limited in demand for a single location. 


Scaleworthy or Scalable Practices 


Practices that have sufficient social and scientific validation to warrant the large-scale 
investment needed to transform these practices into Standard Practice. Scalable practices 
have documentation that they are needed, effective, usable, and feasible. 


Selection 


Selection refers to the purposeful process of recruiting, interviewing, and hiring ‘with the end in 
mind’. Selection through an active implementation lens includes identifying skills and abilities 
that are pre-requisites and/or specific to the innovation or program, as well as attributes that 
are difficult to train and coach. 


SMART Goal 
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SMART is a mnemonic acronym, giving criteria to guide in the setting of goals and/or objectives. 
A SMART goal is defined as one that is specific, measurable, achievable, relevant, and time- 
bound. 


Summative Assessment Data 


Measures used to gather information about student performance compared to grade level 
standards. 


Systems Intervention 


An Organization driver focused on the external variables, policies, environments, systems or 
structures that influence or have impact on the district and schools. 


Training 


Training through an active implementation lens is defined as purposeful, skill-based, and adult- 
learning informed processes designed to support teachers and staff in acquiring the skills and 
information needed to begin using a new program or innovation. 


Universal Screening 


The systematic assessment of all children within a given class, grade, school building, or school 
district, on academic and/or social-emotional indicators that the school personnel and 
community have agreed are important. 
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